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ABSTRACT 

We present a system for complementing snow phenomena 
monitoring with virtual measurements extracted from pub¬ 
lic visual content. The proposed system integrates an auto¬ 
matic acquisition and analysis of photographs and webcam 
images depicting Alpine mountains. In particular, the techni¬ 
cal demonstration consists in a web portal that interfaces the 
whole system with the population. It acts as an entertaining 
photo-sharing social web site, acquiring at the same time vi¬ 
sual content necessary for environmental monitoring. 

Index Terms — UGC, photo-sharing, environmental 
sensing, snow monitoring 

1. INTRODUCTION 

In a period of climate change and shrinking public invest¬ 
ments in monitoring infrastructures, the need of a low cost 
analysis of environmental and ecological parameters is ex¬ 
tremely important. Several state-of-the-art methods that try to 
virtualize the permanent measurement stations using moun¬ 
tain image analysis m, using both ground and aerial im¬ 
ages were recently proposed. These methods suffer from 
the absence or high cost of input data and are insufficient to 
produce and calibrate a really usable mountain environmen¬ 
tal model. On the other hand, the amount of visual User- 
Generated Content publicly available on the Web is reaching 
an unprecedented size. A significant portion of this data con¬ 
sists in public photographs that often depict outdoor scenes. 
We argue that publicly available visual content, in the form 
of user-generated photographs and image feeds from outdoor 
webcams, can both be leveraged as additional measurement 
sources, complementing existing ground, satellite and air¬ 
borne sensor data. In particular we address the problem of 
snow monitoring in the Alpine regions. 

The proposed technical demonstration is an extension 
of El, where several independent components were presented 
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from technical perspective. This work consists in an web- 
accessible integrated system which acts as a central collection 
point for public media content depicting Alpine mountains, 
and its analysis aimed at the extraction of snow cover data. 
Another challenge of the project is boosting social engage¬ 
ment for environmental monitoring. 

2. SCIENTIFIC AND TECHNICAL DESCRIPTION 

The first goal of the system is to acquire a large amount of 
relevant media content. This objective is reached by means of 
tree different processes: I) Relevant photograph retrieval 
from photo-sharing platforms and social networks. Given the 
source of the photographs all the images available in the de¬ 
fined area along with their geo-tags are retrieved. A filtering 
based on the altitude of the photographer during the shot is 
then applied. A supervised learning Support Vector Machine 
performs then a two-class content-based classification, dis¬ 
carding the photos that do not contain clear mountain profiles. 
2) Relevant webcam images retrieval through constant feed 
acquisition. A webcam placed in a mountain region is consid¬ 
ered as a source of relevant photos with a high temporal reso¬ 
lution. Cloudy meteorological conditions, however, are very 
common to be found at high altitudes, therefore only images 
with good weather conditions are automatically identified and 
aggregated daily. 3) Relevant photograph uploading per¬ 
formed by the users engaged directly in the environmental 
monitoring using the photo-sharing web platform. 

Estimating snow cover index from the media content con¬ 
sists in two steps: I) Photograph mountain identification: 
given as input a geo-tagged photograph, estimate the direc¬ 
tion of the camera using a matching algorithm on the photo¬ 
graph edge maps and a rendered view of the mountain silhou¬ 
ettes that should be seen from the observers point of view 0. 
Once the direction of the photograph is known the snow cov¬ 
erage estimation component is invoked. 2) Snow cover area 
identification: the portion of the photograph representing the 
mountain can be extracted by considering only the pixels of 
the rendered Digital Elevation Model view that correspond 
to the terrain points at an altitude above a defined threshold. 
Each pixel of the image representing terrain is then automati¬ 
cally label as covered by snow or not. 



3. IMPLEMENTATION AND USE 

Beside the acquisition of the dataset for the environmental 
analysis, the proposed technical demonstration appears to 
the user as an entertainment social photo-sharing platform. 
The platform provides tools for easy retrieval of multi-source 
mountain media and sharing of own photographs with other 
mountaineers. 

Given an alignment with the rendered terrain view and 
an estimated snow/no-snow mask, several information can 
be obtained for each pixel of the photograph, among which 
whether the pixel represents sky or terrain, what is the al¬ 
titude of the point above the sea level, how distant was the 
point from the photographer, and which points corresponds to 
mountain peaks. The idea is to exploit this information to en¬ 
rich the user experience of exploring mountain photographs, 
allowing the user to switch from simple view of a photo to a 
interactive experience based on the 3D model of the terrain. 
Another important point of social engagement lies in the fact 
that the alignment that brings to the photograph orientation 
estimation and peak identification can be wrong. This can 
occur due to slightly incorrect photograph geo-tag or to chal¬ 
lenging conditions such as bad weather or partial skyline oc¬ 
clusion. The user so can view the alignment between the pho¬ 
tograph and the terrain rendered view, and eventually correct 
it. Once a new alignment is provided by the user, the system 
recomputes the snow estimation based on the new photograph 
direction of view. 
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Fig. I. Architecture schema of the system. 

Figure [T] shows the schematic architecture overview of the 
proposed system. The Environmental Engine is the heart of 
the system, responsible for the storage and the analysis of the 
visual content. The content providers are Mountain Photo 
Crawler that retrieves the relevant photographs from all sup¬ 
ported public photo repositories. Mountain Webcam Crawler, 
that provides acquired images from all monitored public we¬ 
bcams and the Front End Web Portal itself, since users are 
encouraged to upload their own photographs. Environmen¬ 
tal Engine constantly processes new content by identifying 
mountain peaks, estimating the snow coverage and updating 


it when a manual alignment from a user is provided. Finally 
the Front End Portal provides the interface to the users and 
stores all non-environmental information, including social in¬ 
teractions between the users. 

Although the technical demonstration consists in the pre¬ 
sentation of the Front End Portal that allows to appreciate 
the whole architecture and the interactions between the differ¬ 
ent components. Apart from features common to any modern 
photo sharing and social platform (i.e. profile, frienships and 
followers, comments and likes) the most peculiar actions that 
the user will be able to perform during the presentation are; 

- Upload an new photograph and inspect the EXIF data 
useful for the processing. If some data are missing or incor¬ 
rect (i.e. despite the geo-tag imprecisely saved in the photo¬ 
graph the user is sure about the correct location of the photo¬ 
graph) those can be edited and the photograph is then regis¬ 
tered in the system. 

- Explore photographs and webcams on the world map, 
applying several filters, such as; media type, position, alti¬ 
tude, shot date, mountain peaks contained in. Eor a deeper 
exploring of media spatio-temporal frequency distribution, a 
heat map layer is available. 

- Inspect photo details, by interactively exploring the 
mountain peaks identified on the photo together with the 3D 
structure of the terrain by providing altitude and distance 
for each ground point. An environmental mask layer can 
be turned on showing the classification of the image con¬ 
tent in sky/non-relevant terrain (too close to the photogra- 
pher)/ground/snow areas. 

- Inspect webcam details, likewise with the previous page 
analyzing details of a webcam, and the environmental classi¬ 
fied mask. The possibility to start a time-lapse presentation of 
the webcam images is also implemented. 

- Eor each photograph or webcam, inspect the automatic 
alignment performed by the system between the image and 
the rendered terrain view. If the alignment is wrong ,it can be 
adjusted through a non-linear warping of the image. 
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